Changing the state of a memristive system with white noise 
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Can we change the average state of a resistor by simply applying white noise? We show that the 
answer to this question is positive if the resistor has memory of its past dynamics (a memristive 
system). We also prove that, if the memory arises only from the charge flowing through the resistor 
- an ideal memristor - then the current flowing through such memristor can not charge a capacitor 
connected in series, and therefore cannot produce useful work. Moreover, the memristive system may 
skew the charge probability density on the capacitor, an effect which can be measured experimentally. 



I. INTRODUCTION 



If we connect a standard resistor to a random (white 
noise) voltage source, no average current flows in the sys- 
tem, and no change of resistance (state) of the resistor 
can occur. This is simply because of the symmetry of the 
standard resistor with respect to positive and negative 
voltage fluctuations. However, there is now a renewed 
interest in a class of resistors with memory - aptly called 
memristori^ - whose resistance varies according to the 
voltage applied to them, or the current that flows across 
them (for a recent review see, e.g., Ref. |3J. In this case, 
then, a fluctuation of the applied voltage may change the 
state of the memristor; and the ensemble of fluctuations 
could lead to a change of the average state of the mem- 
ristor. If this is the case, what are the implications of the 
noise-induced state change? Is it possible, for example, 
to charge a capacitor through a noise-driven memristor 
to extract useful work? 

In this paper we demonstrate analytically that the ca- 
pacitor can not be charged through an ideal memris- 
tor (one whose state depends only on the charge flown 
through it) despite the change of the average state of such 
device. Although we can not prove analytically a similar 
statement for the case of more general memristive sys- 
tems, our numerical simulations (for a particular device 
model and driving regime) also indicate the absence of 
capacitor charging. However, at least in the case of the 
ideal memristor, we can monitor the change of its state 
by monitoring the charge probability density on the ca- 
pacitor (which can be extracted by placing a voltmeter 
in parallel with the capacitor). This charge distribution 
probability density is skewed by the memory and could 
be detected experimentally. We focus here on an exter- 
nal noise source because the thermal noise intrinsic to 
any resistor (and hence also to a memristor) cannot, by 
itself, be rectified^. 

We note that memristive systemiP are particular types 
of circuit elements with memory^. There are two kinds 
of memristive systems: voltage-controlled and current- 
controlled oneipl. The voltage-controlled memristive sys- 



tems are defined by the equations 

I M (t) = RT 1 (x,V M ,t)V M {t), (1) 
x = f(x,V M ,t), (2) 

where Vu(t) and 1m(£) = 4(t) denote the voltage and 
current across the device, R is the memristance (mem- 
ory resistance) and its inverse is the memductance (mem- 
ory conductance), x = {xi\ is a set of n state variables 
describing the internal state of the system, and / is n- 
dimensional vector function. A current-controlled mem- 
ristive system is such that the resistance and the dynam- 
ics of state variables depend on the curreniP^ 

V M (t) = R(x,I M ,t)I M {t), (3) 
x = f(x,I M ,t). (4) 

The ideal memristor that we consider below is a particu- 
lar case of Eqs. (|3]), Q when the memristance depends 
only on the charge flown through the device: R = R(q). 
Memristive effects are not rare in nanostructures and 
can arise from diff eren t effects including ionic migra- 
tion/red ox re actiond^, spin p olariz ation / magnetization 
dynamic d 9 * 10 !, phase transition d 11 * 12 !, etc. (see Ref. |3]for 
additional examples) . The distinct feature of all memris- 
tive systems is the frequency-dependent pinched hystere- 
sis loopOM A previous study shows that the hysteresis of 
memristive elements can also be induced by white noise 
of appropriate intensity even at very low frequencies of 
the external driving fielcF^H 




FIG. 1: (color online). Circuit schematic: a stochastic volt- 
age source V(t) is connected to a memristive system M and 
capacitor C. 
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In this work, we consider the circuit shown in Fig. [T] 
in which a memristive system M of memristance R and a 
standard capacitor C are connected to a Gaussian white 
noise voltage source V(t). Our goal is to understand the 
circuit response and, in particular, to find the average 
values of memristance and capacitor charge. 

The rest of this paper is organized as follows. In Sec. 
ITT1 we consider the case of an ideal memristor and find 
analytically distributions and average values of the mem- 
ristance and capacitor charge (Sec. II A I. Then, we in- 



vestigate the transient dynamics in the ideal memristor 
circuit (Sec. II B I. Sec. |III| presents a study of noise- 
driven voltage-controlled memristive system. Finally, in 
Sec. |IV| we give our conclusions. 



II. CIRCUITS WITH IDEAL MEMRISTORS 

A. Properties of steady state 

We consider first the case of an ideal memristorJJ whose 
memristance R depends only on the cumulative charge q 
flown through the device. For the moment being, we 
do not select any specific form of R{q) and only assume 
the existence of a memory mechanism leading to an R(q) 
dependence. For the circuit in Fig. [T] the equation of 
motion for q is given by 



R(q) 



dq q_ 
dt C 



V(t), 



(5) 



where V(t) is a stochastic input signal. One can recognize 
that Eq. (|5| is a stochastic differential equation of the 
Langevin type^. It is convenient to introduce a new 
variable x instead of the charge q as 



(G) 



x = I R(q)dq. 



Since the memristance R(q) is positive, R(q) > 0, the 
dependence of x on q given by Eq. (|6]) is a one-to-one 
relation. Consequently, Eq. (|5| can be rewritten in the 
form 



d;F 
dt 



q(x) 
C 



V(t). 



For a given stochastic process V(t), Eq. ^ determines 
the corresponding stochastic process x(t). We assume 
that the stochastic process V(t) is Gaussian white noise, 



(V(t))=0, (V(t)V(t'))=2 K S(t-t'), 



(8) 



where k is a positive constant characterizing the noise 
strength. 

Instead of solving the nonlinear Langevin-type Eq. ^ , 
let us consider the corresponding Fokker-Planck equation 
(FPE) 



dP(x,t) 
dt 



d_ 

dx 



q(x) 
C 



P(x,t) 



d 2 P{x,t) 
dx 2 



(9) 



where P(x, t) is the time-dependent charge probability 
density function. At this point, it is more convenient 
to return to the initial variable q. We perform such a 
transformation taking into account the transformation 
law for the distribution function 



P{x 1 t) = D(q,t)^- = ^ r , 



(10) 



where D(q,t) is the charge probability density function. 
Combining Eqs. ([£]) and (To| we find that the charge 
probability density function D(q, t) satisfies the following 
Fokker-Planck type equation 



dD(q,t) = d f qD(q,t) 
dt dq \ CR{q) 



k d ( D(q,t) 
W)dq \ R(q) 



(11) 



The FPE (11) must be supplemented with an initial 
condition. For example, if at t = the charge on the 
capacitor q — q' with unit probability, then the initial 
condition for the charge probability density function has 
the form D(q, 0) = 5(q — q'), where 5(q) is the Dirac 
delta-function. In Sec. |IIB| we will explicitly consider 
the transient dynamics of the probability density func- 
tion, namely, the evolution of the initial condition into a 
stationary (equilibrium) solution of Eq. (111. Here, in- 



stead, we focus on the stationary solution D (q) of FPE 
(111 satisfying the following ordinary differential equa- 



tion 



gA)(g) K d 
CR(q) R(q) dq 



A)(g) 

R(q) 



— const. 



(12) 



On physical grounds, we can safely assume that the mem- 
ristance R(q) acquires a limiting value at large values of q. 
Then, it is not difficult to show that the general solution 
of Eq. (12) is properly normalized (J Do(q)dq — 1) only 
if the constant on the r.h.s. of Eq. (II2I is zero. Hence, 



the unique stationary solution of FPE (111 is given by 
the following expression 



D (q) =NR(q)exp 



1 

~kC 



qR(q)dq 



(13) 



(7) where N is a normalization constant. Eq. ((l3l clearly 



shows that the charge probability density function is 
Gaussian only if R = const. Any g-dependence of R 
breaks such a property resulting in a non-Gaussian dis- 
tribution function. Typically, in experiments, the mem- 
ristance switches between two limiting values^. It then 
follows from Eq. ( 13 1 that the tails of the probability 



distribution function Do(q) are Gaussian 



D (q) ~ exp 



R(±oo)q 2 
2kC 



±oo, 



(14) 



but asymmetric, since, normally, R(— oo) ^ R(+oo). 

Fig. ufa) presents the charge probability density func- 
tion Do[q) calculated using Eq. ( 13 1 with a specific form 
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FIG. 2: (color online). (a) Equilibrium charge proba- 
bility density function Do(q) calculated assuming R(q) = 
Ron + (Raff - Ron) /(exp [—(q + qi)/qo] + 1) (shown in the 
inset). This model describes a memristor whose memristance 
R changes between two limiting values, R on and Roff- The 
steepness of the transition between R on and R f / is specified 
by a parameter go which is a characteristic charge required 
to switch the memristor. The constant qi is a parameter 
determining the memristance at the initial moment of time 
t — 0. The plot is obtained using R on = lkf2, R ff = 5kf2, 
C — lfiF, qi = 0, k = 0.5V 2 s for several different values of 
go as indicated, (b) Equilibrium charge probability density 
function as a function of qi calculated using the same model 
and parameters as in (a) at go = 10 C. 




FIG. 3: (color online). Shift of the average value of mem- 
ristance as a function of parameter gi specifying the initial 
value of memristance R(0) in the following memristor model: 
R(q) = Ron + {Roff - Ron) (arctan [(q + gi)/go] /ir + 0.5). 
This plot is obtained for R on = lkf2, R on = 5kf2, go = 10 _5 C, 
C = 1/jF and k = 0.5V 2 /s. 



initial state of the memristor (defined by the parame- 
ter qi of the memristor model). Fig. ^b) shows such a 
dependence for a selected set of parameters. The asym- 
metry in the charge probability density function is pro- 
nounced in 1 91/90 1 ^ 1 an d disappears when 1 91/90 1 m_ 
creases. The shift of I91/90I from the region around 
moves "the operational point" of the memristor into the 
saturation region where it behaves as a regular resistor. 



It is interesting to note that, despite the asymmetry in 
the charge probability density function, the average value 
of the charge on the capacitor (9)0 = f_°° qDQ(q)dq in 
the stationary state -Do (9) is always zero, as it follows 
fromEq. pi: 



(«>t 



-NkC 



p+oa 




/ d 


exp | 


I —00 





0. (15) 



of memristance R(q) specified in Fig. [2] caption. When 
the parameter 90 is large (in this limit, the memristor 
approaches the behavior of a usual resistor since a larger 
charge is needed to change its state), the charge proba- 
bility density function is close to a Gaussian (solid line 
in Fig. [2^a)). Clearly, the probability density function 
gains an asymmetry with a decrease of 90 (dashed lines 
in Fig. [2^a)). We note that under certain conditions a 
second maximum in the probability density function may 
develop. An example of such situation is shown in Fig. 
|4|c) below. 

Moreover, it is important to emphasize that the charge 
probability density function -Do (9) also depends on the 



This general result is the straightforward consequence of 
the mathematical structure of Eq. (13). Importantly, the 



property (9)0 = does not depend on the specific form 
of R(q). 

However, a similar property does not hold for the av- 
erage value of memristance (R(q)). which may be shifted 
from its initial value. Since in the general case R(q) is not 
linear in 9, it is evident that (R(q)) = J R(q)D (q)dq ^ 
R(0). An example of such situation is shown in Fig. [3] 
in which the initial state of the memristor is parameter- 
ized by a parameter 91. Referring to Fig. [3j the shift 
of the average value of memristance is mainly positive at 
negative values of 91, and negative when 91 is positive. 
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B. Transient Dynamics 

Next, we use the method of separation of variables to 
find the general time-dependent solution of Eq. (Ill, 



which describes the transient processes in the system. 
For this purpose, we select the specific solutions of Eq. 



(Ill in the form 



DM(q,t) = T n (t)D (q)y n (q). 



(16) 



Substituting Eq. (16 I into Eq. (Ill and separating the 



variables, we obtain the following ordinary differential 
equation for the unknown function y n (q): 



K-Pp(g) dy n (q) 
dq V R 2 (q) dq 



= X n D (q)y n (q), (17) 



where A„ are separation constants. In order to be nor- 



malizable, the specific solutions (16) of Eq. (Ill must 
turn to zero at large q. Thus the functions y n To) a ^ in- 
finity, q — > oo, can grow, but not too rapidly. This serves 
as the boundary condition for the solutions y n (q) of Eq. 
(17 1. In particular due to the asymptotic behavior (14 1, 



the solutions y n (q) can grow as a power law at large q. 

The equation for functions T n (q) is trivially integrated, 
and it gives the following solutions 



T n (t) = a„t 



-A„t 



(18) 



where a n are arbitrary constants. 

The general time-dependent solution of the Fokker- 
Planck equation (111 can be presented as a sum of the 
specific solutions (16 1 with Eq. (18 1 taken into account 



D(q, t) = D (q) a n e~ Xnt Vn{q)- 



(19) 



n=0 



Constants a n can be determined from the initial condi- 
tion for the probability density function D(q, 0) by using 
the weighted orthogonality of the solutions y n (q) of Eq. 



It is impossible in general to integrate analytically Eq. 



(17 1 for n > 1, or even to find the relaxation rate Ai, 
which is the minimal nonzero relaxation rate. But we 
can make use of the variational approach to obtain a 
reasonable approximation for this rate. 

Let us determine the functional acting on an arbitrary 
function y{q) as 



F[y(q)] = 



f +°° J «-Po(<3) ( dy{q) \ ' 
J-oo R 2 (q) \ dq J 

£~ dqD (q)y*(q) 



(23) 



It is easy to show by using integration by parts in the 
numerator of Eq. ( 23 I , that the value of this functional 



for the solution y n (q) of Eq.(17l coincides with A r 
r + °°da d ( KDo{q) *MnM. \ y („) 

J-oo a 1dq { R 2 (q) dq J V*W 
F [Vn{<l)] = — = A « 



HZ dqD (q)y*(q) 

(24) 

Moreover, since the first variation of F turns to zero for 
the solutions of Eq. (17), they are the stationary func- 



tions of functional ( 23 1 



Note that because of the non-negativity of the func- 
tional, F[y(q)] ^ 0, we get the same inequality for the 
relaxation rates A n J? 0. 

Straightforward calculation from Eq. (p4| shows that 
for an arbitrary function y{q) = X) 



=0 



F[y(q)] 



Z^n=0 A " L n 



n— 



+oo 2 



c n y n (q) we find 
(25) 



o u n 



If c = 0, i.e. a test function y{q) is orthogonal to the 
function yo(q) = 1 in the sense that 



dqD (q)y(q) = 0, 



(26) 



then from Eq. ( 25 1 it follows that for such functions 
Aicf + \ 2 c\ 



cf + c4 



> Ai 



(27) 



Noting that the function y(q) — q satisfies Eq. (26 1 we 



dqD {q)y n (q)y m (q) =0, n ^ m, (20) nnd thc following estimation for the relaxation rate 



which follows from the fact that Eq. (17) has the self- 
adjoint form. As a result we find 



F[q] = k 



a( i R 2 {q) 



f^dqD (q)r 



> Ai. 



(28) 



D(q,t) 



dq'G(q,q',t)D(q',0), 



where 



G(q,q',t) = D (q)Y^ 



y n {q)y n {q') 



dqD (q)yl(q) 



(21) 



(22) 



Thus the characteristic relaxation time r of the system 
under consideration can be presented as a quotient of 
averages over the stationary state Do(q) 

<9 2 >o 



(29) 



When the resistivity R(q) = Rq = const, i.e., if we 
consider an ideal resistor, then Eq. (17 1 becomes the 



is the Green function of FPE (111, which corresponds to Hermite differential equation. In this case we have 



the initial condition G(q,q',0) = 5{q — q'). 

The value Ao = corresponds to the unique stationary 
state ( 13 ), and from Eq. ( 16 1 we conclude that yo(q) = 1. 



Vn{q) = H n \q 




7 A„ — 



CRq 



71 = 0,1, 



(30) 
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where H n (x) is a Hermitc polynomial. The stationary 
solution ( 13 1 is the Gaussian distribution 



D (q) 



Ro 
2itkC 



exp 



flog 2 
2kC 



(31) 



with (q )o = kC/Rq, and from Eq. (29 1 we find the 
well-known relaxation time of a RC circuit, r = RqC. 



Thus we see that for this case the estimate ( 28 I gives the 
exact relaxation rate Ai = 1/r = 1/(RqC). Note that in 
the case of constant resistivity even the Green function 
p2| can be calculated in a closed form, being a Gaussian 
distribution with respect to q and q' at any moment of 
time t. 

A better understanding of FPE solutions can be gained 
by noticing that Eq. (11) is similar to the drift-diffusion 



equation. Rewriting the right-hand side of Eq. (Ill as 
K dR(q)~ 



d_ 
dq 



q 



CR{q) R 3 {q) dq 



D(q,t) 



K dD(q,t) 
W(q)~ 



dq 
(32) 

we readily interpret the first term in Eq. (|32j) as the drift 
and the second term as the diffusion term. Moreover, the 
expression in the square brackets in Eq. ( 32 ) plays the 



role of e/iE in the usual drift-diffusion equation, where 
[a is the mobility. Assuming /i = const, we introduce an 
effective electric field acting on the probability density 
function as E e ff — A[...] with A is a positive propor- 
tionality constant and [...] is from Eq. (32 1. In the most 
simple situation, when R = const, E e ff — —Aq/(CR). 
Notice that in this simple case E e ff changes its sign at 
q = thus pushing the charge probability density func- 
tion toward the stable point q — from both positive and 
negative values of q. The diffusion term in Eq. ( 32 1 tends 
to increase the distribution width. A balance between 
drift and diffusion is responsible for a finite distribution 
width. 

In the case of memristor, the expression for E e ff ac- 
quires an additional contribution (the second term in the 
square brackets in Eq. 32). Assuming that R(q) is a 
monotonically increasing bounded function (e.g., as in 
Fig. [2] caption model), this contribution can only locally 
increase E e ff in the region of R(q) gradient. In cer- 
tain cases such an increase has interesting consequences. 
Specifically, it may result in the development of addi- 
tional stable points as Fig. [ija) exemplifies. 

Figs, ijb)-(c) present the dynamics of the charge prob- 
ability density function for the case of one and two stable 
points (these plots correspond to the E e ff curves in Fig. 
ga)). In the case of Fig. |4jb), the initially slower drift of 
D(q,t) peak accelerates as the memristor passes through 
its switching region. At this point, the charge probability 
density function widens and then narrows back concen- 
trating about q = 0. The presence of two stable points 
in the system results in a two-peak shape of the charge 
probability density function at longer times. Note, how- 
ever, that < q >= at t —> 00 as it follows from Eq. 
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FIG. 4: (color online), (a) An effective field E e ff calcu- 
lated for two different values of C and memristor model spec- 
ified in Fig. [2] caption. Two stable points are denoted by 
arrows. The horizonal dashed line is for the eye. The calcu- 
lation parameters are R on = lkfi, R ff = 5kfi, qo = 10 _5 C, 
qi = — 0.00025C, and k — lV 2 s. (b) Dynamics of the charge 
probability density function at C = 5/^F. (c) Dynamics of the 
charge probability density function at C — 50/^F. (b) and (c) 
have been obtained assuming that the initial capacitor charge 
is narrowly distributed around 5 x 1CP 4 C. 



III. CIRCUITS WITH MEMRISTIVE SYSTEMS 

In this Section we consider the circuit shown in Fig. [l] 
where M is a threshold-type memristive system. Such 
a configuration is of great interest since many exper- 
imentally demonstrated memristive systems exhibit a 
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threshold in their switching dynamics (see, for example, 
Refs. I3|7jl 5 16). However, mathematical/computational 
modeling of such cases in the presence of noise is com- 
plicated by non-linear noise terms entering the equa- 
tions of system dynamics. In fact, accurate mathemat- 
ical/computational approaches to treat such situations 
still need to be developed. Here, we study the circuit dy- 
namics based on some intuitive arguments complemented 
by numerical results found for a linearized model. 

Let us consider a specific regime of circuit operation 
when fluctuations of the input voltage source (Gaussian 
white noise is assumed, see Eq. ^) are smaller then the 
threshold voltage of the memristive system Vt, so that the 
voltage across the memristive system M is smaller than 
V t for the most of the time. In this regime, the switching 
events of memristance are relatively rare. Their intensity 
is determined by the voltage fluctuations across M given 
by Vm = V(t) — Vc, so that fluctuations of both V(t) 
and Vc are important. 

One can notice that during the intervals of constant 
R, the fluctuations of Vc are described by the Ornstein- 
Uhlcnbeck process. Consequently, 



4000 



Var[Vfc(t)|Vfc(0) = 0] = 



RC 



1 



(33) 



where 2k is the noise strength of V(t). If we use Eq. 
( 33 1 as an estimate for the amplitude of typical voltage 



fluctuations across the memristive system then it follows 
that such typical fluctuations are weaker for larger values 
of R and stronger when R is smaller. Consequently, we 
expect that the memristive system M spends less time in 
states with smaller R (since the probability of switching 
from these states is higher due to stronger fluctuations) 
and more time in states with larger R. Our qualitative 
prediction, thus, is a rather larger value of (R). 

In order to test this prediction, let us consider a specific 
model of a voltage-controlled memristive system with a 
"soft" threshold such that Eq. ^ is written as 



= a sinh 



Vm 
V 



(34) 



where a is a constant, Vt is the threshold voltage and 
x = R. It is also assumed that R on < R < Roff- The 
circuit shown in Fig. |T|is modeled by a couple of stochas- 
tic differential equations describing evolution of stochas- 
tic variables q and R. We linearize Eq. p4| with respect 
to small values of the input V(t) and solve the two linear 
stochastic differential equations numerically^. Some re- 
sults of our simulations are presented in Fig. [5] This plot 
shows that the average value of memristance R increases 
in time in agreement with the above discussion. More- 
over, for the selected values of parameters, our numerical 
simulations do not reveal any significant deviations of the 
average voltage across the capacitor from zero, and asym- 
metry in the charge probability density function. We 
emphasize that our numerical results should be consid- 
ered mainly qualitatively as the linearization procedure 
is valid only for small fluctuations of V(t). At the same 
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FIG. 5: (color online). Simulations of the circuit shown 
in Fig. [TJ with a voltage-controlled memristive system (Eq. 
(|34[)). The curves show the memristance averaged over 5000 
realizations ({R}) and several examples of particular realiza- 
tions of memristance (Ri). This plot was obtained using the 
parameter values a — 0.1f2/s, R on = lkQ, Roff = 5kfl, 
R(t = 0) = 3kQ, V t = 0.2V, = O.lVVs. 



time, these results support our qualitative considerations 
above, e.g., regarding the average value of R. 

The dependence of the variance of Vc on R given by 
Eq. ( 33 1 can also be applied to understand the asymme- 
try of the noise distribution function shown in Fig. [2] for 
the case of ideal memristors. We recall that in these de- 
vices the memristance R is a function of q only, namely, 
R = R(q). Consequently, when q is positive and R is 
large, the voltage fluctuations (according to Eq. ( 33 1 ) 
are reduced and, consequently, the charge probability 
density function is narrower. In the opposite case of neg- 
ative q, the voltage fluctuations are increased (because 
R is smaller) and the charge probability density function 
is wider. This is exactly the same behavior as observed 
in Fig. [2] We anticipate that in the case of memris- 
tive systems a similar change of the charge probability 
density function is also possible in the regime of strong 
noise, when the memristive system stays under switch- 
ing conditions during a significant fraction of the time 
evolution. However, in the case of weak noise considered 
here, the correlation between charge flown through the 
memristive system and its state is almost negligible, and 
therefore we do not expect any significant asymmetry of 
the charge probability density function in this regime. 



IV. CONCLUSION 

To summarize, we have shown that the charge prob- 
ability density function may be modified in memristive 
circuits coupled to white noise sources. In the specific 
circuit example that we have considered (memristor and 
capacitor driven by a stochastic voltage source), the dis- 
tribution gains an asymmetry that disappears if we re- 
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place the memristor by a usual resistor. We have proved 
analytically that for any charge-controlled memristor, the 
average charge on the capacitor is zero. This is a very 
surprising result taking into account the fact that the 
memristor introduces a circuit asymmetry. We have also 
developed a formalism to describe the evolution of the 
charge probability density function. It can be used to de- 
scribe non-equilibrium processes in the circuit (for exam- 
ple, the discharge of the initially charged capacitor). We 
finally note that our theoretical predictions can be easily 



tested experimentally with available mcmristivc systems. 
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